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(57)Ab$tract 

PURPOSE: To control an AV equipment totally 
by forming a system With the AV equipment 
and an intelligent AV remote commander 
inter^commiiniGating an instruction and 
information. 

CONSTfTyTION; The system is provided with 
a display section 102 such as si: liquid crystal 
dispiay device and a cathode ray tube as an 
inforrnatidri proyisfori rnearis to the user and an 
audio output section 105 such as an audio 
output terminal and a built-in speaker or the; 
like and aJ$o with: an 104 
receiving the control and the entry is 
conducted by using a touch panel, a mouse 

and a pen or the tiks; Furthermore* in order to mak$ 2-way communication without the 
AV equipment; a communication section 103 is provided. The communication Section 
103 adopts a radio system using an infrared ray or an FM wave or the like or a wired 
system connecting directly to an AV equipment by a cable, Furthermore^ a storage 
section 106 for various information and for various setting is provided and <a memory 
or a hard disk or the like is used. A control section 101 is provided to analyze and 
generate script and data and control I ing each section. 



;* NOTICES * 

JPO and Will are not responsible for any 
damages caused by the use of this translation. 

IThis document has been translated by computer So the translation may not reflect 
the original precisely. 

shows the word which can not be translated; 
3.1n the drawings, any Wor-ds are not translated;, 



CLAIMS 



[C)aim(s)3 

[Claim 1]a remote controller transmitting a command of Information mutually using 

said means of communication between the singular number or two or more audio 

visual devices characterized by comprising the following which are alike and set and 

have the same means of communication as said remote controller. 

A means of communication by radio or cables; such as Infrared rays and an electric 

wave; 

An: input means of a device which detects existence, strength; coordinates, or 
continuous time of a depression With a pen a finger; etc as a displaying means of a 
liquid crystal a cathode-ray tube, etc;, a mouse, or a microphone, a memory measure 
which memorizes a variety of information, and a central processing unit, 

[Clairh £}ln claim 1 statement; bMween the singula 

visual devices with the same means of communication as said remote controller, 
Information, including a command for controlling said audio visual device, a picture, or 
a sound, Or a remote controller being based oh language: form based oh specific 
grammar, and transmitting or receiving an operation situation of said audio visual 
device or said remote controller using said means of communication,: 
[Giairn 3]Said comrnand according to claim 2, information, or an operation situation 
transmitted or received in claim 2 statement using said means of communication, A 
remote controlier having an inverter : pr conversion algorithms for changing language 
form based on said specific grammar into both directions or a urn directional in an 
inside or the exterior. 

tplaim 43ln claim 1 statement; between the: singular number or two or more v aadio 
visual devices with the same means of communication as said remote controller, A 
remote controller transmitting or receiving status Which shows an operation situation 
of apparatus, or a command which operates apparatus using said means of 
communication, 

[Claim 5]A remote controller using said means of communication, and transmitting or 
receiving picture information or speech information in claim T statement betweien the 
singular number or two or more audio visual devices with the: same mean s of 
communication as; said • rti G^ke.^ corvljpSil$r* 

[Claim 6]In ciiaim 5 statement, the singular number or two or more audio visual devices 
with the : same means bf communication as said remote controller according to ciaim 1. 
A remote control I er • wherein it compresses picture information or speech information, 
it transmits to said remote controller and said remote controller decodes transmitted 



said compressed picture information or speech information. 

[Claim 7]A remote controller provided with a means to input speech information of a 
means or a microphone etc. wta such as a camera, in 

claim i statement, 

[Claim 8]The singular number which has the same means of communication as said 
remote controller according to claim 1 in claim 7 statement or two or more audio 
visual devices, Or a remote controller compressing or carrying out non compression 
and transmitting picture information or speech information inputted into said remote 
controller according to claim I and same another remdte controller by said means of 
communication. 

[Claim 9]A remote cpntrolier memorizing compression, picture information by which 
noh compression was earned out, or speech inforftiation in claim 5, 6 or 7, or 8 
statements to memory storage connected to the exterior of (said memory measure or 
said remote controller according to claim 1. 

[Claim 1Q]A remote corrtrbller reading said memorized compression, picture 
information by which noh compression was carried but, or speech information in claim 
9 statement. 

[Glaim 1 1]A remote controller decoding said read picture information which was 

compressed or speech information in claim 10 statement. 

[Claim 12]A remote controller characterized by displaying by said displaying 

based on data transm fcte d in claim 1 statement from the singular number or two or 

more audio visual devices: with the samis means of communication as said remote 

controller. 

[Claim 13]A remote contrbller haying a voice output means of a loudspeaker, an audio 
output terminal etc. in claim 1 statement 

[Claim 14] A remote controller processing in claim 1 statement to an Input; performed; 
by, a predetermined input means. 

[Claim 1 5] A remote controller processing a command or information transmitted using 
Said means of communication in ciaim 1 statement. 

[Claim !6]A remote controller processing in claim I statement to a sound inputted 
using: saidin^ 

[Claim 1 7]ln claim 1 statement, . when transmitting a command or a variety of 
information using:said .means of communication;; A remote; cpntrpller adding subject; 
equipment specification information on an audio visual device used as a transmission 
object or said remote controller, and same another remote controller to said command 
or a variety of information. 



[Claim 1 8]A remote controller extracting subject equipment specification information 
that apparatus used as a transmission object was specified, in claim 1 statement from 
a command or a variety of • information received using: said: means of communication, 
[Claim 19] A remote controller determining whether process said command according 
to claim 18 or a variety of information received with said subject equipment 
specification information using said extracted subject equipment specification 
information in claim 18 statement.. 

[Claim 203 A remote controller characterized by trans mitting said command or a 
variety of information when hot processing said command according to claim J 9 or a 
variety of information is determined using said subject- equipment specification 
information iri claim 19 statement 

[Claim 21 jan informMiori personal digital assists a command or 

information mutually using said means of communication between the singular number 
or two or more audio visual devices characterized by comprising the following which 
are alike arid set and have the same means of c^mmuhifeatioh as said information 
personal digital assistant; 

A means of communication by radio or cables, such as infrared rays and an electric 
wave. 

An input means of a device which detects existence, strength/ coordinates, or 
continuous time of a depression with a pen. a finger, etc. as a displaying i mearis of a 
liquid crystal a cathode-ray tube, etc;, a mouse, or a microphone, a memory measure 
which memorizes a variety of information, and a central processing unit, 

[Claim 22]!n claim 21 statement, between the singular number or two or more audio 
visual devices with the same means of communicatiort as said information personal 
digital assistant' Information, including- a comma nd for control ting said audio visual 
device; a picture, or a sound; Or an information personal digital assistant being based 
on language form based on specific grammar, and transmitting or receiving an 
operation situation of said audio visual device or said information personal digital 
assistant using said means of communication. 

[Claim 23]Said command according to claim 22, information* or an operation situation 
transmitted or received in claim 22 statement using said means of commuhicatipn. Ah 
information persona! digital assistant having an: inverter or conversion algorithms for 
changing language form based on said specific grammar ;info bdth directions or aunj 
directional ih ah inside or the: exterior. 

[Claim 24jln claim 21 statement; between the singular number or two or more audio 



visual devices with the same means of communication; as said informatiDn; personal 
digital assistant, An information personal digital assistant transmitting or receiving 
status vvh i ch shows ah operation situation of apparatus, or a command which operates 
apparatus using said means of communication; 

[Claim 25]An information personal digital assistant using said means of communication, 
and tnahsmittiriig or receiving picture information or speech information rri claim 21 
statement between; the singular number or two or more audio visual devices vyith the 
same means of communication as said information personal 4\g\t$\ assistant 
[Claim 26i(n claim 21 statement, the singular number or two or rnore audio visual 
devices with the same means of communication as said information persona I digital 
assistant An information personal digital assistant; wherein it compresses picture 
information or speech inforrnatian, it transmits to said information personal digital 
assistant and said information personal digital assistant decodes transmitted said 
compressed picture information or speech information. 

[Claim 27}An : iri^rma^on personal digital assistant provided; with a; means to input 
- speech information of a means or a microphone etc. which inputs picture iMormatidh; 
such as a camera, in claim 21 statement 

[Claim 28]The singular number which has the sa me means of cprnrnunicatipn as said 
information persona! digital assistant according to claim 1 in. claim 27 statement, or 
two or more audio visual devices* Or an information personal distal assistant 
compressing or carrying out non compression and transmitting said picture 
information or speech information inputted into said information personal digital 
assistant according to claim 1 and same: another information personal digital assistant 
by said means of cpmrnunicaiibn. 

[Claim 29]An information personal digital assistant memorizing £ in / for any of claims 
25 thru/br 28 their being / a statement ] said compression, picture information by 
which non compression was carried put, or speech information to memory storage 
connected to the exterior of said rr*emory measure or said information personal digital 
assistant according to claim 21 . 

[Claim 30]An information personal digital assistantreading said memorized: 
compression, picture information by which non compression was earned out or 
speech information in claim 29 statement. 

[Claim Si ] An infprmatibn; personal digital assistant decoding said read picture 
information which was compressed or speech information in claim 30 statement. 
[Claim 32]An information, persionai digital assistant characterized by displaying by said 
displaying means based on data trahshlitted in claim 21 Statemeht from the singular 



number or two or more audio visual devices with the same means of pomrnunicBtion 
as said information personal digital assistant 

[Claim 33]An information persona! digital assistant having a voice output means of a 

loudspeaker; an audio output terminal etc, in claim 21 statement. 

[Claim 34] An information personal ] digital assistant processing in claim 21 statement 

to ah in put performed by a predetermined input' means. 

[Cia irri 35] An information personal digital assistant process i tig a command or 

information transmitted using said means of communication in claim 21 statement. 

[Claim 36]An Information personal digital assistant processing in claim 21 statement 

to a sound inputted using said input means, 

[Claim 37]ln claim 21 statement, when transmitting a command or a variety of 
information using said means of (iornmutw personal digital 

assistant adding subject equipment specification information oh ah audio visual device 
used as a transmission object/ the remote controller according to claim; 1 or said 
information persona! digital assistant, and same another information personal digital 
assistant to said command or a variety of information. 

[Claim 38]An information persona! digital assistant extracting subject equipment 
specification information that apparatus used as a trans mission object was specified, 
in claim 21 statement from a command or a variety of information received using said 
means of communication- 

[Claim 39] An information personal digital assistant determinm said 
command according to claim 38 or a variety of information rec^iyed with said subject 
equipment specification Information using said extracted subject equipment 
specification information: in cla^ 38 statement, 

[Claim 40]An information p^r^dnal digital assistant characterized transmitting said 
command or a variety of information When hot processing said command according to 
claim 39; or a variety of information is determined using said subject equipment 
specification information, in claim 39 statement 

[Claim 41 ]in an audio visual device provided with a means of communication by radio 
or cables; such as infrared rays and ah electric 1 vvave/ Apparatus with the same means 
of communication as said audio visual device, such as an audio ; visual device, a remote 
cohtroller s or 6n information personal digital assistant, and an audio visual device 
communicating bidirectibnaliy using said means of commuhiciatioh; 
[Claim 42]In an iaudip visual device provided With a means of cpmmuhicatiph by radio 
or cables, such as infrared rays and an electric wave, An audio visual device 
communicating with an audio visual device or sin information personal digital assistant 



with the same means of communication as said audio visual device to a uni directional 
using said imeans of communieatidh> 

[Claim 43]; In claim 41 or 42 statements, were transmitted or received using said 
means of communication. A command for controlling said audio visual device by 
language form based on specific grammar Or information, including a picture or a 
sound, Or a remote controller with the same means bf communication as said audio 
visual device or said audio visual device. Or an audio vteuai device haying an inverter 
or conversion algorithms for processing an operation situation of an information 
personal digital assistant in ah inside or the: exterior; 

[Claim 44]An audio vtsual device extracting an> specified said 

subject equipment in claim 41 or 42 statements from a transmitted command which 

specified Subject equipment or a variety of information . 

[Claim 45]An audio visual device determining whether process a transmitted 

commend which specified said subject equipment or a variety of information by 

referring; to ah information part which specified said subjecrt equipment in claim: 44 

statement. 

[Claim 46]By referring to an information part which specified said subject equipment 
in claim 45 statement, When not processing a transmitted command or a variety of 
information which specified said subject equipment according to claim 45 Is 
determined, . Have the same means of communication as said audio visual device 
according to claim 41 or 42, An audio visual device transmitting 5a command or a 
variety of information which specified said subject equipment as other audio visual 
devices; remote controllers, or information personal digital assistants. 

DETAILED DESCRIPTION 

[Detailed Description of the Invention] 



[Industrial AjpplicatiohjThis invention relates to ai remote controller, an information 
personal digital assistant, and an audio visual devifce It ts related with a system (a 
remote controller, an information personal digital assistant/ the system that combined 
the audio visual device suitably) for a user to manage ah audio; visual device 
comprehensively and simple, at a home etc. especjaiiy; 



[Description of the Prior ArtjThere are various audio visual devices (AV equipment is 
called hereafter) including television or Vtft in the present home. The latest A V 



equipment Has many which can be operated now with -a remote; controller (a remote 
control is called hereafter) even from the distant piece, its number of remote controls 
increases inevitably with increase of the number of AV equipment, and ft has the fault 
that operation becomes complicated; cover the f u notion of two V or more remote 
controls with one set that it should be solved -~a learned type remote control called 
** has already appeared oh the market in the commercial scene. 
[0d03]8y building a wireiess communication network between a computer; a factory 
process controller, and a handy terminal as an example of construction of the system 
using the infrared ray comrnuiiicatioh used with the usua I remote control^ 
JP,2-25773 IA is indicating a means by which information is exchanged and this 
system can be expanded to uses, such as communication, maintenance, and diagnosis. 
[0004] 

[Problem(s) to be Solved by the InventidrijRbwever, the above-mentioned learned 
type remote control must carry out setting out vyith an a priori complicated user in 
many cases, arid one button takes' charge of two or more functions according to 
target A V equipment and userrfnendliness is not necessarily good. That is t many 
tilings which a user has to memorize exist. When AV equipment increases in number 
dramatically : correspondence becomes impossible, and it has the fault that only a part 
can b S operated a mong th e operational functions of AV equipment 
[0005]tn the art indtcated by above-mentioned djp f 2^57731 A an 
infraredrray-comnrHinication unit and a network device are required, and: the situation 
where a network can be built usi ng: thi s system is restricted: That is. it is impossible to 
intrdduc^ this system at home only for viewing and listening of AV equipment as a 
matter of fact. 

[OpOS]The place Which tHis invention was made in view of the above-mentioned point 
and is made ihto the purpose. By communicating m AV equipment and both directions, 
without introducing the speciaHpurppse--machine machine of a large amount of 
investment or many, ft is in providmg the intelligent AV remote control which may 
raise a user's user~friendliness by leaps and bounds by performing batch management 
of the AV equipment in a home etc., and having the outstanding user i nterface. 
[0007] 

[Means for Solving the Problemjlh order to attain the above-mentioned purpose, an 
intelligent AV remote control by thiS: invention is provided with the following. 
The . communications department by infrared rays, radio including an electric vyaye^ or 
a cable. 

Input parts,. such as ia touch pane! which detects depressions, such as a pen, a mouse; 



and a finger, . 

indicators, such as a liquid crystal and a cathode-ray tube 
A voice output part; a storage parts 

and a control section for processing of various data or control 
[0008] 

[Function] An intel ligent A V : remote control displays various information on an 
indicator to a user On the other hand, when a ; user chooses a predetermined field by 
an input part, a user s intention is transmitted to this tnteliigent AV remote control. 
The: communications department exchanges a variety of information in other AV 
equipment and both directions: A voice output part outputs a sound to a user. By 
providing the above each part in an ihtelligent AV remote coritroH it becomes possible 
to exchange the exte ri or, and various : i nf o rmation and volition; And the portion which 
memorizes ^ parts store, and a control section 

manage s al I the pbrtiohs des cnbed ^bove, 

:[00G9] 

; [E xamp I ejMereaft er> the example of thi s invention is des fcri bed usi tig a drawing, 
prating; i is a block diagrarn shew intelligent AV remote 

control concerning one example of this invention, 

[OOlCOAs shovvn in Sliwingjv there are the indicators I02 r such as a liquid crystal and 
a cathpde^ray tube, and the voice output parts 105* such as an audio output terminal 
for an earphone, headphone, a speaker, etc. and a built-in speaker, in the intelligent 
AV remote control iof this example as users* information presenting means first. In 
order to receive users' operation, the input part 104 is formed, and a touch panel, a 
mouse, a pen etc. are usually used, but the microphone for voice input and other input 
means can be established, and facilities can also be given to a person with an 
inconvenient input by a ;hand T etc. 

[OOHjin order to perform other AV equipment and two-way communication, there is 
the communications department 103: Either the radio system by electric Waves- such 
as ; infrared rays and an FM wave, or the wired system which :conneets : with AV 
equipment directiJy by a: eg ble is OK as this. 

[001 2]Th ere is the storage parts store i Gfc for carrying out memory: of various 
iriformatipn, including various setting: out by a user, setting .out of AV equipment, etc;, 
etc., and a memory, a hard disk, etc, can be used. A storage parts store can also be 
provided in the exterior .of ah intelligent AV remote control. 

[001 3]The control section 101 performs control of above-mentioned each part and 



analysts, of a script. or data and generation The procedure which controls each 
element used as the operation target of AV equipment is described, and a script is 
synonymous with a program here. The feature that communication becomes possible 
between the AV equipment handling the script of a different form and this intelligent 
AV remote control can be given by providing the interpreter which changes an 
interpretation and form of a script in built-in or the exterior at an intelligent AV 
remote control. 

[0014]Since the function same naturally can be exhibited if it has the same 
composition as the abovermentioned intelligent AV remote control , the same role as 
the aboye^mentioned intelligent AV remote control can be imposed on the 
general-purpose apparatus generally called an information persona! digital assistant. 
Here > with an i nformati on pers onal digital assistant, what can do things: other than 
control of the AV equipment which has the same configuration as the intelligent AV 
remote control by this invention, and is explained here is pointed put The advantage 
that AV equipment is controllable by the abb ve-mehtioned information persona! digital 
assistant utilizable for various uses by this arises At this time, such [ from the first ] 
a function may be given to said information persona! digital; assistant* and it is 
changeless to the above-mentioned functi also in the form of adding a program, an 
interface, etc. for controlling AV equipment: afterwards; Therefore, in no the following 
examples and drawings, even if an Intel tigent AV remote control is read with the above 
information personal digital assistants and it changes it, the contents change, 
[$0*5}^ figure showing one example of the appearance of the 

abovermentioned intelligent A V remote control. In this example, as shown in "dra^mf 2, 
there is the liquid crystal display and touch panel 20 1 , and it serves as: the input part 
with a display portion, a finger, etc. in order to communicate with AV equipment; the 
infrared ray interface 202, the electric wave mterface 203, and the cable connector 
204 are formed and communication by radio (an electric wave infrared rays) and a 
cable is suppbrtedi Thus- the advantage that it can respond even if two or more means 
of communication which: AV equipment performs exist simultaneously arises; by 
establishing two or more communication interfaces. Qf cpurse; even if only one has a 
communication interface there is no change in a function: And the earphone jack 205 
for connecting ah earph one. headphone, etc . and the loudspeaker 206 are formed . as a 
voice output means, 

[OQ1 : 63;C3^vvir % .3 # xplam$ communication between the intelligent AV remote control 
301 and AV equipment 302. The communication between the intelligent A V remote 
control 301 and AV equipment 302:is usually an exchange of a command, status or a 



script and data That the intelligent AY remote contr ol 301 and AV equipment 302 
communicate, (A); When; arr intelligent AV remote control performs the check of 
existence of AV equipment or operation (303A), (B); when an intelligent AV remote : 
control controls AV equipment (303B), it is a time (3030) of hking to give the 
information which has (C); AV equipment m an intelligent AV remote control etc: 
tOOITlRrst, in the above (A), it is equivalent to 303A of ^US^J^ but this is 
performed every fixed time, when operation of an intelligent AV remote control begins 
The: tirne of operation of an intelligent AV remote control beginning is a time of 
predetermined operation prescribed that operation is started being performed, when; a 
user switches [ operation start J on the intelligent AV remote control The check of 
existence of A V equipment or operation performed every fixed time is for confirming 
whether AV equipment still exists in the communication range of an intelligent AV 
remote control or what kind of operation if it exists, is performed, The intelligent AV 
remote control is [ this j Wdh in portability^ 

While the user had had an intelligent AV reimote control, when it moves, it is -a means 
for coping with a possibility that the AV equipment it becomes impossible to 
corpmuniqate wilt come out 

However, this i s caused by not every fixed time but a certain predetermined operation, 
[001 8}Next, said communi cation content of 303A is explained, First, an intelligent AV 
remote control scans the surroundings using a means of communication. Then, the 
response from AV equipment comes Jon the contrary. As for this, an intelligent AV 
remote control sends an AV equipment check comman d or a s o ri pi the procedure in 
which the AV equipment Of a controlling side answers it and Sends- data may be 
sufficient, or the apparatus of a controlling side is sending data etc. always or 
intermittently, and the procedure of receiving it may be sufftcient as an intelligent AV 
remote control At this time, the data sent from the AV equipment of a controlling side 
is the data of a script and others which described the procedure which controls each 
element of the A V equipment which can carry Out apparatus ID and control of the AV 
equipment, As an example of apparatus ID of AV equipment, the kind of AV equipment, 
a product name, a maker a serial number, etc. are mentioned When AV equipment is 
VTR, for example; a controllable element is each function; such as playback, rewinding 
a rapid traverse, a halt a stop, and recording, and the script corresponding to.them is 
sent from AV equipment. The icon information for displaying the button of each 
function on the screen of an intelligent AV remote control may be then sent 
simultaneously, Furthermore, the data of an icon when displaying AV equipment on an 
intelligent AV remote control may be sent, as one of the other data: 



[0019]Ne>rt, the contents of 303B of >*|^£^in the above (B) are explained When, a 
user specifies operation of AV equipment on an intelligent AV remote control or when 
it admits that an intelligent.^ communication is 

performed between an intelligent AV remote control and A V equipment; At this time, 
ID of the AV equipment used as a controlled object ID of the object used as a 
controlled object an execution script, data to that object, etc, are sent to AV 
equipment from an intelligent AV remote control Thereby, the user can operate AV 
equipment On the other hand, corresponding to it, the status or script showing the 
present operation situation is sent to an intelligent AV remote control from AV 
equipment 

[0020]Display the picture of W etc. on the screen of an intelligent AV remote control, 
or, When outputttng a Sound from speech output units, such as headphone connected 
with a loudspeaker or an audio output terminal with a built-4n intelligent AV remote 
control, a picture and voice data — - non compression •—•or compressing^ said 
operation situation status — or it can also send to ah intelligent AV remote control 
from AV equipment independently* 

[002t]The contents of 3 03 G of drawirig 3 i n the above (C) are explained to the last. 
When this has a certain abnormalities with effect or 

script is sent to an intelligent AV remote control from AV equipment; Vtihen a user 
needs to get to know generating of the abnormality, when an intelligent AV remote 
control carries out a screen display of the abnormality according to said script, even if 
there is ho user near the A V equipment which abnormalities generated, the abnormal 
occurrence can be known. When carrying out a screen display of the 
abpve-mehtibned abnprnri^lities, the user can acquires the feature that abnormalities 
are cancelable; by: displaying the solution simultaneously, without wav/erihgv The 
aboye^mentioned solution may be beforehand memorized by a certain method in the 
intelligent AV remote = control, and when AV equipment tells abnormalities etc it may 
be included in the script sent to: an irtteffigeht AV: remote control. When art intelligent 
AV remote control copes with it unusually [ the AV equipment X an intelligent AV 
remote control sends the script for management to object A V equipment For example, 
when CD is put into a CD player and CD which a certain error generated and put m 
has not been recqgnized, a CD player makes the; abnormal occurrence and its solution 
a spript, and transmits to an intelligent AV remote contrpL The splutibn opens; the tray 
of a CD player once, and closes again, and when CD is recognized . again the intelligent 
AV remote control which received the script transmits the script of the purport that 
the operation is perfbrrried : to a CD player. And the intelligent A V remote control can 



display orna screen the message of the purport that sard abnormalities occurred at 
this time, and it can be urged that it warts to a user: 

[0022]f Here are some methods in construction of the system of an inteillgent AV 
remote control and the AV equipment which is controlling sides. There are that to 
which two-way communication is possible between AV equipment and between an 
intelligent AV remote control arid AV equipment; and a thing which is hot performed or 
it cannot perform communtcation between AV equipment in AV equipment first. Here; 
the AV equipment which cannot perfortt) communication between AV equipment has 
referred to the thing in which operation with a remote control is possible with 
convent ionai AV equipment Even if it is each AV equipment: in which said two-way 
communication is possible, a system configuration which considers bidirectional 
communication as an ihtefligent AV remote control can also do only some AV 
equipment. It is very effective when all AV equipment and intelligent AV remote 
controls are not in the situation vyhose : two-way communication is possible; then:. 
™ the case where all AV equipment performs an intelligent AV remote control: and 
two-way communication — ™ when some AV equipment communicates with ah 
intelligent AV remote control, the case where the AV equipment and the system 
which cahhc& perform will be shown below. It 

shall hot be asked that the radio by infrared rays, an electric wave, etc; or a cable is 
the communication said here, 

[002339^^r^4ijS a system configuration example in the above-mentioned ** ; and is 
the example which built: the system with the AV equipment in which said two-way 
communication is possible, and the intelligent AV remote control. When all the AV 
equipment and intelligent AV remote controls are (n the same room, it becomes a 
prbpagatioh path of such information^ 

[0G24]The television 408 which; contains satellite broadcasting, cabfe TV. etc. as AV 
equipment of a controlling: side. The stereo 409 containing a CD player, a tuner, a 
cassette deck the DAT deck MD deck, the DGC deck, a record player, amplifier- etc., 
VTR4D7, the LD player 410, etc; are mentioned, and, naturally there may be-other AV 
equipment 41 1. These;: varioys AV equipment may have more than one, respectively; In 
the example of this dfmmg^ the stereo 409 TV408. VTR407 the LD player 410, and 
other AV equipment 41 1 are eommunieating with the intelligent AV remote control 
401 separately, and each AV equipment has two-way cpmmunicatipn possible, for 
other A V equipment 

[0025]The mouse 402 and the pen 403 which: are the external inputting: means of the 
composition by the side of thejinteiligent AV remote control 401 are the same as the 



mouse in the input part 1,04..;af fk&f&jfsJ? 3 a pen respectivety. 

It i $ provided when the input means of a touch pane! etc. js not buttt m an intelligent 

AV: remote control. 

the headphone 404. the earphone; 405, and the loudspeaker 4Q6 which :are voice 

outside output means are the same as that of the headphone in the voice output part 

1 ®5 &f drawing I; an earphone; and a loudspeaker respectively. 

It can connect when the audio output terminal; is provided m the;: intelligent AV remote 

control. 

[0026]ln order that the intelligent AV remote control 401 may communicate with each 
AV equipment, respectively in the case of a system configuration like this dr^jrlg^ it 
has the ; feature that few t i me fags from transmission of « to the operation 

start of transmission destination AV equipment are. in this composition, it is also 
possible to transmit and receive a sound and a .picture signal, and no troublesome 
wiring needed but it is very furthermore easy to use between apparatus by 
communication betvveeii the AV equipment of this system instead of the cables for 
sending a conventional sound aftd picture signal for a user 

[GQ£ 7 3 Dr^n^js a system configuration example in the above mentioned **> and in 
this system configu ration exa mp le shown in the figure as well as M|^|j^,4 v the AV 
equipment which is a ****** side may be various, and may have them, respectively, 
[ two or more 3 The- mouse 50£ the pen 503, the headphone 504 s the earphone 505 : 
and the loudspeaker 506 connected to the inteiligent AV remote control 501 are the 
same as that of the above mentioned mduse of $MM^A< * P eri > headphone,, an 
earphone, and ai loudspeaker. Mere, all the AV equipment is performing the intelligent 
AV remote control 501 and two-way communication via ^ 
the example for which AV equipment 511 of the stereo 508, the LD; player 509, 
VTR510. and others is communicating with the television 507, respectively. Radio and 
a cable are not asked as [ that the means of communication at this time is natural ] 
above-mentioned. 

[00 28] Although the situation 507 which cannot carry out the direct cofnmuhicatiori: of 
a certain AV equipment with the intelligent AV remote control 501 even if by 
considering d as a system corittgurattonlike this -§-;^M!mA for example, television, is 
m the same room as the inteHigent:AV remote control 501 Even when sayrng that the 
stereo: 508 is in another room, the intelligent. AV . remote; control/501 has the effect 
that the stereo 508 is contrpilabte; by passing the television 507, It is performed in the 
procedure in which a script Mtc : ; af-e fir&t transmitted to the television 507 from the 



stereo 508, and the .teteyisidii 507 whibh: recei^ed it transmits the; script : "of the 
above-mentioned stereo 508 to the intelligent AV remote control 501 , and a reverse 
procedure is also possible for it; 

[0029]The inside of the AV equipment which is a controlling side iafaout the interpreter 
which interprets, a script For example, only the televisipn 50? has and a command 
•which is used wrth the remote centre! of the former [ between / the television 507 and 
other AV equipment 3 In the script can b6 exchanged between the intelligent AV 
remote control 501 and the television 507. According to this method, no A V 
equipment needs to have an interpreter and it has the feature that simp! ifica ti on of 
the circuit of AV equipment can be attained It is possible to transmit and receive a 
sound and a picture signal by communication of this system as well as ^^MiJ. 
[0030jDrav^ng 6 is .a system configuration example in the above mentioned **, and is 
the example which built the system with the intelligent AV remote control 601 and the 
AV equipment which is not carried out or it cannot perform said two-way 
communication. Although the AV equipment which is a side may be various 

like dmwm^ 4 and there may be more than one. respectively in the example of this 

The stereo 607, TV6GS/VTR609, the LD player 610, and other AV 
equipment 611 are communicating with the intelligent AV remote control 601 
separately . The rnpuse 002 and the pen 603 which are the eternal inputting means of 
the intelligent AV remote control 601, respectively — the mouse of .said -dmwmg'l 
carried oui r and a pen ™ the headphone 604, the earphone 605 t and the loudspeaker 
606 which are ypice outside output means are the same as; that of the headphone of 
said ifl^lof il^amed- out;- -ah .earphone, and a loudspeaker respectively; 
[QOSliThe advantage which constructs a system like this drawing. 6 is being able to 
constitute a system also from AV equipment which cannot perform two-way 
communication between apparatus When a remote control constitutes such a system 
from operBtibnal conventional AV equipment and the intelligent AV remote control 
601. As the unified type remote control which controls AV equipment based on the 
data inputted beforehand, br a learhed type ^ remote control which can control 
apparatus now by : memorizibgvO a; certain remote -control from the start 

later to AV equipment This intelligent AV remote control 601 will operate However, 
the different feature from such a conventional remote control is a point provided with 
ah outstanding user interface like the after-mentioned That is although §^*BM L $$M 
§r^mgj>^ showed the : AV : equipment w perform two-way communication 

between apparatus, : and the example which constitutes a system.: also in this example, 
AV equipment is controllable by the completely same menu manipulation. 



[003 2] in the AV equipment with a communication function described above, -although 
data etc can be bidirectional! y exchanged with an i nt eiitgent A V remote control t it rs 
said that communication is impossible with other AV equipment ^ so to speak, it may 
be two-way communication ppasible AV equipment of a short form When a; system is 
constituted from this short form two-way communication possible AV equipment and 
an intelligent AV remote control, a system configuration completely becomes the 
safite-pn *i^fhg&;and appearance- However, it becomes the form that the 
communication between AV equipment and an intelligent AV remote control covers all 
the content^; shown in >^wl|i^ v arid only the exchange of the data between AV 
equipment, etc. cannot be performed; 

[QQ333in drawing: 4 - ■#awiq^:6 » the AV equipment whose two-way commtintcation is 
possible, the AV equipment in which said short form two-way communication is 
possible; and the AV equipment which is hot carried out or two-way communication is 
impossible can be mixed and a system can be constituted for these as AV equipment 
of a controllihg side, ft pan coritihue using in this system, without buying hew 
conventional AV equipment, even when a user purchases by this the new AV 
equipment whose two-way communication is possible. At this time, that AV 
equip mem may shovy what ki nd qf communicati on is possible by the indicator of ah 
intelligent AV remote control and does not need to show ft. When shown, the user can 
know that the range by which an intelligent ; AV remote control can control the AV 
equipment is restricted. When npt shown, whether a user does not have the: 
knowledge abp or does hot khdw what kind of 

communication function the system comprises AV equipment with, until can treat ah 
intelligent. AV remote control to some extent 

[0O343in 9MM$S^ sound and an 

image may be connected between A V equipment or between AV equipment and ah 
intelligent AV remote control For the reasons of the burden to time, quality and 
hardware etc,,: when it is difficult for this to transmit and receive a sound and picture 
information: by the: communication function of this system, it is an effective means; 
[b035jAnd by providing the interpreter Which changes the form of a script in built-in 
or the exterior m d^v^r^-4 : r' draw ing -Q-: at each AV equipment. The feature that 
communication becomes possible between the AV equipment handling the script of a 
different form and between AV equipment and an intelligent AV remote control can be 
given. Build said interpreter in one certain AV equipment or an interpreter is provided 
independently. When it is made to perform communication between AV equipment or 
between AV equipment and ah intelligent AV remote control via the AV (equipment or 



interpreter, even if rt does not provide an interpreter in other AV equipment or 
intelligent AV remote controls, communication becomes possible mutually; 
[0036]Next the example of a user interface of an intelligent AV remote control is 
shpyvn. The feature of the user interface of this intelligent AV remote control It is two 
or more methods" being set as performing operation with AV equipment, it being 
intuitively intelligible by using a simile; giving facilities to a user by displaying vairious 
information simuitaneously. and being able to change a screen display according to a 
users request 

|j^373Pr^v^?ng ?1s ^ figure showing one example of the initial screen of an intelligent 
AV remote control The result "to- whrch, asf ifor dr^r^J, the intelligent AV remote 
control transmuted the AV equipment check command by the means of 
communication It is a display example when there Is a response, respectively from the 
television 701 . the stereo 702 > video (1 ) (videocessette recorder) 703, video (2) (video 
movie) 704, and the LD player 705> Hovyever, communication of each AV equipment 
illustrated here shall be possible for other AV equipment an irtteiltgeht AV remote 
control, and both directions. 

[0038]What has been sent as dat3; is expressed to the intelligent AV remote control as 
this screen from each AV equipment except the icon of the time 706 and the help 
button 7Q7, However, it may be made for an icon to assign the data which the 
intelligent AV remote control has from the first based on the kind pf AV equipment 
Although the AV equipment name under an icon; assigned the equipment name which 
the intelligent A V remote control has memorized from the first based on the data sent 
from each AV equipment the: data of the product name etc, which have been sent 
from each AV equipment sis they are tnay be sufficient as this. In this way > ah 
intelligent AV remote control memorizes the variouS :data about each AV equipment 
transmitted once to memory storage, such as a memory or a hard disk. It may be 
erased at the time of the operation finish of the intelligent AV remote control which 
: c 6u I d be • la st in g • as fo r this memory and was caused by a certain predeterniihed 
operation. 

[Q039]The help button 707 is always displayed on the screen, when an operation 
method needs operation of intelligent AV remote controls other than operation of AV 
equipment setting out, etc ; and to be explained, it is used; but it mentions later for 
details. It may be made to always display the time 706 and a user is made to do setting 
out of whether to always display. By displaying the time 706, it becomes useful at the 
time of setting out of the timed recording of Videa etc, 

[0040]D r ^r ig 9 blocks the above-mentioned example of an initial screen of d^mmgT 



Although the i nte) I tgeht A V remote control :SG;1 is described until now, the: pen 802 is 
formed for the loudspeaker 803 in the Intelligent AV remote control 801 as a voice 
output means as an external ihputtmg means here agaui; respectively. As AV 
equipment of a controlling side; the stereo 80S, the LD player 806. VTR(i) 
(videocassette. recprder) 8Q7> and VTR(2) (video camera) 808 : are in the state where 
communication is possible with the intelligent AV remote control 801 via the television 
804v That is, it is the same as "the state which showed in jk^m^^ 
[0041] Jvlext> when the response from the A V equipment in which the intelligent AV 
remote control was able to check existence before it is lost ? ** is just explained. Since 
an intelligent AV remote control uses it for the same purpose as the usual remote 
control while the user had had it, it -has very often moved. It may become impossible 
as: a result, tp-^pmiinM^icdte; an; intelligent AV remote control and AV equipment. For 
example; it is a case where an intelligent AV remote control and AV equipment were 
communicating on radio, and ah electric wave, infrared rays. etc. which are the means 
of the radio stop amy ing etc. Therefore, when every fixed time and predetermined 
operation are perforated, it iis checked how as for an int el li gent AV remote control . 
each AV equipment is operating now again in A V equipment and the situation whose 
communication is possible; 

[0042] When it describes above, the example of a block diagram when the response 
frorri the AV -^q^lpment'yirHich was able to cH^jR Jxi?teite$ is lost before it Is 
f. In the example shown in this drawing &■> in the aforementioned example of 
configuration shown in drawing: 8, communication is impossible with the intelligent AV 
remote control 801 for the reason etc. which VTR(2) 808 described above, and which 
Apparatus is in the situation whose communication is impossible like VTR(2) 908 of 
itwgiQg 8. The other intelligent AV remote control 901 « the pen 902, the loudspeaker 
903. the television 904 the stereo 905. the LD player 306, and VTR(i ) 907, It is in the 
intelligent AV remote control 801 of ^m^g k the pen 802. the loudspeaker 803, the 
television 804, the/stereo 805. the LD player 806 f and the state where it is the same 
as VTR(I) 807, and the same, respectively. 

[0043]Pm^iJI shows how the above-mentioned state of c fe ;vy^g:;g is reflected in 
the display of an ihtelligeht AV remote control screen, In the example of a screen 
display of this. dra;yr^ : 5'0 >t th^/response from the video (2) (yidep movie) 1004 [ same ]• 
as VTR(2) 908 of drg^gg^is lost, arid the user visually told; abpiit the situation 
where communication is impossible for a certain rea son by putt in gy x sea i on the icon 
of video (2 X By giving such a . function to an intelligent A V remote control; even rf it. 
pushes the button^ which tends to occur while using the conventional remote control. 



irritation in case anything does not have a reaction of AV equipment etc are 
cancelable* At this time, a user s embarrassment is also mitigable by displaying a 
solution on the screen: of an intelligent AV remote control; the television 1001 of 

^ stereo 1002, video (1 5 10Q3 r the LD player 1005, the time 1006, and 
the help button 1007, It Is the same as the television 701 of g^vvingj., the stereo 702, 
video (1) 703/the LD player 70S. the time 706; and the help button 707 respectively. 
[O044]Dra^^ |l is an example of a screen display in the; case of actually operating 
AV equipment on the screen of an intelligent AV remote control 
Here, one example of operation when playing video (1) wais shown; 
the icon of video (1 5 703 of ^HQg;, rwhiob- i$i an initial screen first is selected with 
predetermined pointing devices, such as a pen, a mouse, and a finger And In the state 
where it Was chosen, it is p ut on the i con of the television 70 V to display a 
reproduction screen on: Then, the icon of television will also be selected and it will be 
shown that a series of operations which the user performed now are effective, 
[0045] the icon of video (1) lapping on television, as described above, and being 
further chosen by the icon of 11 01 in drawing (by a diagram* hatching is performed) 
feshown v As shown in di^k^J-i, a thing like the shadow 1 103 of video (I 1 ) can be 
displayed bjl the portion as which the icon of video (I) wa£ displayed from the first; 
and H can specify that: video (1) was moved from the original position by that cause. 
Of course, it is not necessary to display the shadow 11 03 of video f1) t Operation of 
putting this videocassette recorder in television is a simile of displaying video on 
television; 

Compared with the conventional remote control, it has very i nt urtivefy the advantage: 
that it is intelligible. 

The script Which described operation by this operation by a user to the AV equipment 
whrnh corresponds to Video (1) from an intelligent AV remote control is sent The 
stereo 1 102 of <iravy IT video (2) 1104, the LD player 1 105, the time, 1106, and the 
help button 11 07 are the same as the stereo 702 of d^^^ J video (2) 704 the LD 
player 705,: the time 706; and the help button 707 respectively* 
^[d0463fe.y^.|€.is an example of a display screen of an intelligent AV remote cpntrpl 
when not using a simile [ as / as was explained- by 1.1 J. Only in the: case 

similariy selected with sai finger and a pen^ 

the window 1208 for operation of video (t) 7Q3 opens the ipon of video CO 703 of 
<i 1^ which is an initial screen. Each icon of the television 701 and the stereo 702 
which were displayed in the initial screen at this time .video (J ) 703 video (2) 704 and 
the LD pibyer 705, it is redrawn in a position and a size which are; not hidden in the 



operation window 1 208' of v i dec ( i ), 8 e cortii n g likfe the television 1 202, the ; stereo 1 203, 
video CD 1201, video (2) 1204, and the LD player 1205 respectively, the icon 1201 of 
video |1) Will be in the selected state be, the state where hatching was performed in 
this figure- further. 

[0047]Jn the operation window 1 208 of video (1), The button 1216 for recording 
immediately the title 1209 of a window, the present tape counter 1210, the rewind 
button 121 1, the reproduction button 1212; the fast forward button 1213, the pause 
button 1214, the earth switch 1215, and now, icons, such as the timed recording 1217, 
are displayed. Therefore; if the reproduction button 1 2 1 2 is chosen with pointing 
devices, such as a pen arid a finger, here, playback of Video (1) will be started. 
[OO483lnthe exam0l^ of this^gw|M j;^ sincei the object which displays a screen 
exists only in: television, the reproduction screen pf video ( 1 } is autornaticaliy 
displayed on television, but when there are two or more televisions, the window for 
choosing the object which displays the reproduction screen of video (1 ) opens. By 
carrying put like this, operation of the conventional remote control or AV equipment 
can carry out pn an intelligerit AV remote control, a way can be copied in exactly the 
same way, arid effect that a user is not bewildered by use of this intelligent AV remote 
control is achi eved In order that the window 1208 may express visually [ be / of which 
AV equipment / it / a window ]; % thing like the marks 1218 which the window opened 
may be diisplayed, By carrying out, like this, even if it does nbt read the title 1209 6f a 
window, it becomes pwhat window is Open and ] possible to catch visually, 
[0049]Drg}^n^ j 3 js an example of a display screen of an intelligent AV remote control 
when playing the videocassette recorder which corresponds to video ft) using the 
procedure etc. which were shown in J|^^^.ll:;pr ^tl^M.M- this figure, video (1) 
1301, the television 1302, the $tereo 1304; video (2) 1305, and the LD player 1306 are 
the same as that of video (1) 703 6f ;feHd£j* : the television 701 . the stereo 702, 
video (2) 704, and the £D player 705 : respective^, this example -is in the state Which 
the operation window 1310 of video (1) is opening so that video (1 ) can be operated 
immediately, The volume control window 1 309 : is also opened so that the volume of 
television cah be adjusted similarly. 

[OOSdjThe user can know the operating: state of the present video (1) easily by 
displaying, where [ 1^14 ] a reproduction button iis chosen, the character 1311 which 
expresses that it is under playback with the operation window 1310 of videoCl.}, and 
Then, by displaying the tape counter 1 31 2 of video (1); even if a user does hot go hear 
the videocassette recorder, he can know the residue of videotape. The user can make 
it the reference at the time of volume control by displaying the present volume on the 



volume control window 1309 numerically with a regulation button. 
[0051]On the other hand although the states j e , hatching where video £1)1 3Q1 and 
the television 1302 were chosen is g^yen in the ioon ^<^AV:«.stdpi)rM^tN$^h0yffi that 
video (1) and the television are operating now. Although the loudspeaker 1303 is 
displayed beside television, this shows that the sound has come out from teleyisipn 
novv; By operating the icon 1303 of this loudspeaker, the sound: of video (1) 1301 can 
be uttered from other AV equipment, or it can be made not to utter the sound of the 
television 1302. The selected Window of the AV equipment which utters a sound may 
be displayed at the time of a: video and a User may be made to choose; 

When there is two or more apparatus which displays a picture, the icon which shows 
the window which chooses t& and image display may be provided like the icon 1303 of 
the ^bove-mentiohed loudspeaker. 

[0052]The button 1318 for recording immediately in the window 1310 of the video 1 
the rowing button 1313, the repr^ 1 31 4, the fast: forward button 1315, 

the pause button 1316, the earth switch 1317, and how and the timer reservation 
button 1319 f It is the same as that of the button 12 1 8 for re cording immediately the 
rewind button 1211 of drawing 12; the reproduction button 121 2, the fast forward 
button 1213, the pause button 1214, the earth switch 1 2 1 5. and now. re^pectivefy, arid 
the timer reservation button 1217. The time 1:307 and the help button 1308 are the 
same as the time 706 of drawing J, and the help button 707 similarly. 
[0053] Dr^mg 44^16 one example of the display soreeh of ah intelligent A V remote 
control in the case of performing timed recording setting out of video. In this jfewlng 
H video 0 ) 1401, the television 1 402 ; the stereo 1403- video (2) 1404, and the LD 
player 1 405 are the same as that of video (i^v?03;'-of 'driving ? < :'the : td^yfeioh 701, the 
stereo 702, video (2) 704, and: the LD player 705 respectively. In the example shown in 
few 14, the window 1409 for reserving video (i) m open, and this 
request-tp-print-out~files window 1409 is opened when a user selects the 
request^OHprmt^out-files icon : 1217 in the operation window 1208 of the video (1) of 
draM^j2: In ord^rto:;show- it; pn:; : a.i $0rieen > ;Ha.tching- iS'perf orme'd and: displayed on the 
lower right 1 408 of this request-tO"-print--out-fiies window 1409 in the state, Le;> this 
figure where the above-mentioned request-to-prmt-out-fifes tcori 121 7 of 
Vi was; selected. 

[QG54]fn the above-menboned request-to-pnnt-out-files window 1409, it roughly 
divides, there are two fields and one is the field 1410 for the. display of the: situation 
reserved now, arid the field 141 1 for the request to print out files with new another. In 
the former field: 1410, a date, video recording start time, recording finish time; and: a 



channel are describing. An trtdicatfon foir Choosing: a date, video irecofding: start; tim 
recording finish time, and a channel similarly *s given to the fatter field 141 1 However, 
greatly different points from the conventional remote control are pointing devices 
used with this intelligent AV remote cohtrol/isuoh as a peri, a mouse, and a finger, and 
are being able to write in a. date to reserve directly, time; etc. on a screen And 
character recognition of the written-in number is carried out After erasing inputted 
drawing, ft may be made to display: input data in a pnn ting type anew. Thereby, the 
user can confirm whether the input which he performed is effective. In order to input 
simply; the structure 1412 for changing date s^pecificatipn, day~oHtoe-week 
specification or the morning, an afternoon, etc. by one-touch can also be established, 
it does hot set up by writing a character to a screen directly, and from the date 
already displayed in the form of the table etc., a day of the; week, time; and a channel, 
even if it is th> forrn of choosing the thing; of hope; an effect does not change, 
[0055]There are the button 1413 for cancellatibn and the button 1414 for an end in 
the reauestHto-pn 1409 of video CO t-« and cancellation and an 

end of a request to print put files can be performed now simple. The time 1406 and the 
help button 1407 are the same as the time 706 of drawing 7, . and the help button 707 
respectively. 

10056] Dr^wbg JSJs bneexarnple 6f the display screen of aih intelligent AV remote 
control in the case of channel selection when viewing and listening to tele vision> Jn 
dfrawfe*:; 7 which is an initial screen of an intelligent AV re mote; control this dr£i?H?lil:§, 
is an example of a screen display when the icon 701 ! of television: is selected with a 
predetermined pbihting device. Therefore; hatching has been performed by the icon 
1 502 of television in the selected state, i.e., this figure. In this example shown in this 
<&®mn*j& the window 1309 for volume control of the television of iEgE^l^S 
window 1508 which makes the same rp|e t and the window 1509 for choosing the 
channel of television are open; 

[0057]The thing with the same appearance as the conventional remote control is 
displayed on the window 1 509 of channel selection, 
Usage also only chooses the channel (for example, 1510) of hope with a 
predetermined pointing device, and is not less than the useHfriendliness of the 
conventional remote control 

At this time, facilities can be given to a user: by displaying the name of a television 
station into la channel button like 1 510 apart from the number which shows a channel 
What the : intelligent AV remote control; memorized a priori may be sufficient as the 
name of this television station, and what the user set tip by predetermined operation 



ma$ be sufRci^nt as. it, 

[0058] Although: it is mentioned as one of the features of this intelligent AV remote 
control that a picture and votce data are receivable by communrcatiorvfrom apparatus 
That feature can be efficiently empioyed by choosing the field 15 J 1 in the Window 
1509 of channel setting Written "To project on this screen" with a predetermined 
pointing device in d^v^g 1;^, TTWtvfe; if the described area 151 \ is: chosen, a picture 
and an audio signal are sent to an intelligent AV remote control frpm television, and it. 
can view and listen to television on this intelligent AV remote control The voice 
output part 1 05- of an intelligent AV remote control is then used for voice response at 
image display using the indicator 1 02 of the intel f igent AV re mote control of ^g^ll J 
(0059]Sihce it is possible for each AV equipment and an int^liigent AV remote contrdl 
to communicate mutually in this system: configuration example. If it is a place in which 
either of AV equipment: and communication are possible, also at a place wfthout 
television it is effective in becoming possible to view and listen to a TV program on 
this intelligent AV remote control. A picture and a sound are then transmitted to AV 
equipment by said means of communication from television in an order said from AV 
equipment to an intelligent AV remote control The state of the picture: transmitted in 
this way and voice data does hot ask compression and horv compression. When 
compressing, since it is compression* the software or hardware for decoding to an 
intelligent AV remote control is needed for AV equipment but there is an advantage 
that there are few images between AV equipment and an intefligent AV remote control 
and transmission times of voice :data, and they end. When incompre ssi b) e , compared 
with the time of carrying out the above-mentioned compression, there is an 
advantage that the circuitry of A V equipment and an ihteiiigent AV remote control 
becomes easy. 

[OOeOjBy providing the capture function of continuing displaying; the screen until it 
memorizes TV footage with a user s directions and there are: a Users directions as it 
is; in an intelligent AV remote control, Also when the information which a user wants to 
acquire thoroughly com^s out on television, facilities can be: given to a user The 
memory storage formed in the memory storage of the exterior established in the 
intelligent AV remote control can be used for memory of the TV footage at this time 
[006 i]ln 4^Ml§<- Wdep >ti) 1 501 . the televisjon 1 502; the stereo TSOl video (2) 
1504, the LP player 1505 f the time 1506, and the help button 1507, H is the same as 
that of video (1) 703 of Mrm^0_ "I the television 701, the stereo 702 video (2) 704 the 
LD player 705; the time: 706; and the: help button 707 respectively. 
Cd0623Dr^vy^rg: 16 is an example in the case of viewing and listening to a TV program 



on an intetligent AV remote controL Here, the intelligent AY! remote control is 
sideways carried out so that it may be easy to display TV footage On the screen of an 
inteliigent AV remote control TV footage 1604, the time 1603; the volume seftirig-dut 
window 1601; the channel selection window 1 602; the; stop button 1 605 of television 
reception, the help button 160$ etc. are displayed. 

£0063]The volume settihg-out window 1601 is the same as the volume setting^out 
window 1309 of d^v^^jj^ 

A channel to view and listen is freely changeable by choosing the button in the 
chahhel selection winddw: 16Q2 with a jpredetermirved pointing device. 
At this time, the channel number of the television station currently displayed oh 
[ other than the button into which a channel is changed ] a present intelligent AV 
rernote control may be displayed, and facilities may be given: to a user. Arid if the stop 
button 1 605 is chosen in the state of ||^^h^'t|; the screen of an inteliigent AV 
remote control will return to states, such as dr^ng; 7 or ;dm^sgQ]|; again, It comes 
to be able to perform management of AV equipment, etc: simply by displaying arbitrar^y 
information, including the operation situation of other A V equipment, etc , besides 
these things, In ^#fM.j& the time 1 603 and the help button 1608 are the same as 
the time 706 of dpawing .7. and the help button 707 respectively. 
[Q084 ]DmWmg 1? i s ah; example of a screen display when a help button is chosen ih 
the initial screen of the intelligent AV remote control xrf fr^ng l, etc; At the lower 
right of the screen in this example, the help button 1 707 Is chosen npw > namely^ 
hatching ha? been performed on this screen. Since the: help button 1707 was chosen, 
the window 1 708 for setting out etc/ is also opened. The field for eicptehatioh of the 
operation method of this inteHigent AV remote cpntrol. setting out of a televisibn 
channel and a television statipn,and other setting out is displayed on the setting^out 
window 1708; 

If it chooses with a predetermined pointing device as stated until now, the Window for 
theses will open further,. 

An end button can also be displayed: in this window 1708 for the end of this operation:: 
When a user can operate it easily and provides: the* help button same for setting out of 
the television: channel, etc. : setting out: ^ channel! the 

conventional system ] by carrying put like this, Since a manual can be directly referred 
to oh a screen when a user does not understand the method' of operation; it is 
possible -V0iy'iti :! ^varfou8^^neiiooA> compared with the conventional remote control, 
and to attain simplification, 

E0065]lh Irawngj.?, video (1)1 701. the television 1702, the steireq 1703; video (2) 



1704, the LD flayer 1j05 ( and the time 1706 The respectively same role as video (1) 
703 of the television 70 J the stereo 702 video (2) 704, the LD piayer 705, 

and the time 706 is made, 

[0066]As mentioned above, this intelligent AV remote control has the feature that the 
data which carries out a screen display can be processed. Therefore, it can arrange on 
* a screen freely, or a screen can also be rotated at any time like d^widg ; .i0; and 
facilities can be given to a user so that conveniently [ a user's use ]< 
[Q067]When the power supply qf an intelligent AV remote control is cut ; by 
predetermined operation, or when a users predetermined operation is performed an 
intelligent AV remote control may transmit a command, a script, etc- of powering off 
to each AV equipment Since the power supply of all ths AV equipment which 
communicates with it can be cut by turning off an intelligent AV remote control at 
once by that cause, the user can perform bate h ma hage meint of th e power supply of 
at! the AV equipment, without parrying put compiieated operation. 
[006 8] Here t vyhen two or more these intelligent AV remote controls exist, the case 
Where the contents which i each intelligent AV remote control transmitted to the same 
AV equipment; such as a command and the script, differ can be considered In order to 
avoid it a priority is attached to two or more intelligent AV remote controls by a 
user s operation etc ,. and when AV equipment receives the command etc which 
cannot exist simultaneously, AV equipment can hear the intelligant high .command of 
the priority. By doing so, it becomes possible to prevent that the activity of AV 
equipment changes quickly, arid malfunction of AV equipment 
[00693 

[Effect of the lnvention]By this invention, it has the same means of communication as 
this intelligent AV remote control or an information persona! digital assistant as 
mentioned above; And a: system consists of AV equipment which can exchange a 
command and information mutually, in a script, i e, the language form based on specific 
grammar by this means of communication, and this intelligent AV remote control or an 
information personal digital assistant 

Therefore, it enables a- user to control the above-mentioned AV equipment that.it is 
simple and. comprehensively. . 

By providihg the interpreter which intelfprets : the above-mentioned script and is 
generated in the exteripr of an intelligent AV remote control or an; information 
personal digital assistant The effect that a command and information can be : 
transmitted mutually is acquired also between the intelligent AV remote control or the 
information personal digital assistant and AV equipment which differ in the form of 



the script to treat. 

[0070] 8 y adding various processing to the command and information which the 
intelligent AV remote control or th£ information personal digjtal assistant acquired: by 
said method, the user interface according to the case of being various can Be built 
now* and it becomes possible to give facilities flexibly to a user. 
[007 1 ]In the composition of the intelligent AV remote control by this invention, or an 
information personal digital assistant. When a picture signal is transmitted to an 
intelligent AY remote control or an information personal digital assistant from AV 
equipment in compression or the state where non compression was earned put other 
than said script it is effective in the ability to see it on the screen of an intelligent AV 
remote oontro! or an inforrnation personal digital assistant. At this time; the feature 
that a user can hear the sound in the compression transmitted with the described 
image signal or the state Where hon compression was carried out can be acquired by 
providing a built-in loudspeaker and an audio output terminal in an intelligent AV 
remote control or an information personal digital assistant. By once memorizing the 
picture or audio signal in the state: where it was compressed then sent to the memory 
storage connected to the intelligent A V remote control or the ihfomiation persbhaj 
digital assistant to built-in or the exterior, The effect that correspondence also of an 
intelligent AV remote contrPi or ah ipfornriatipn personal digital assisitent without the 
function decoded in real time becomes possible shows up. 

[0072jThe intelligent AV remote control or information personal digital assistant of 
this invention. Since the coiiventionaf AV equipment which can carry put remote 
cofiirSI operation is also controllable as usual, when a user uses this intelligent AV 
remote control or an information personai digital assistant, he has the effect th^t it is 
not necessary to purchase AV equipment newly. 

[0073]By memorizing a certain instantaneous picture and sound to the intelligent AV 
remote control or information, persona! digital assistant of this invention, arid Providing 
further again the function which continues reproducing it, Even when the necessity 
that a user wants to stop the information on television etc suddenly runs, the demand 
can be filled quicHiy and easily. 
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[Brief Description of the,: Drawings] 

lB^iSEJ.i^ * s a block .diiagram-.shpw:ing ( the- composition of the intelligent AV remote 
control concerning the example of this invention. 



^^^.ing^fcJ? a. perspective view showing one example of the appearance of the 
intelligent AV remote control by the example of ths invention. 

example of the contents which 
communicate between the intelligent AV remote control and AV equipment fay the 
example of this inyentipn. 

[^r^h££|It is a system configuration by the intelligent AV remote control by ari 
example and AV equipment of this invention, and is a system configuration figure in 
cjase AV equipment communicates wH;h an intelligent AV rempt^ control separately 
and each AV equipment cbhimuniGates mutually' 

gSrawi^ 5] By the system configuration by the intelligent AV remote control by an 
example and AV equipment of this invention, AV equipment communicates with 
television and television is a system corffigura^qrV figure m the caise (whehAV 
equipment is communicating with the intelligent AV remote control via television) of 
communicating with an intelligent AV remote control. 

[D^v|^r6]Itrg-:gr system configuration by th^ ihtelligerit AV remote control by; an 
example and AV equipment of this invention, and is a system configuration figure in 
case AV equipment communicates with an i nte II igen t A V remote control separately 
and there is no communication betvyeen each AV equipment 
[Q^^n| 7|lt is an explanatory view showing one example of the initial screen 
displayed on the intelligent AV remote control by the example of this invention, 
j^^ngj^lt is a system configuration figure showing one example of a configuration 
ih case the sci'efcn of sMMiM^J^ displayed. 

,Q3 ^vyj^ ;93tt i:s: : ,a system cohfiguratton figure $bow it became 

impossible to communicate video (2) and an intelligent AV remote control in ^ra^i^£§> 
y^wig£j^|lt is ah explanatory view showing one example of the display screen of 
the intelligent AV remote control at the time: of the state which ighoweti by ^rav^rM §• 
t&zm^R 1'1 jft is an explanatory view showing one example of the display screen of 
the intelligent AV remote control m : the case of playing video (1) in ; ^n|]; 
2?!^MEE1S^ iS art explanatory view showing one example of everything but the 
display screen of the intelligent AV remote control in the case of playing video (1) in 

[Dpwi??g^lit is ah explanatory view-showing one example .-of the. displ.ay'- : screen of 
the intelligent :£V rfcmtfte -^ontrd *isit''tHe: time of playihg.viclep Cl);in : ;jfe^i|M : i % and 

IP^Wi^g ;*4]lt is an explanatory view showing one example of the display screen of 
the intelligent: AV remote control in the case of performing timer reservation of video 



WM is an explanatory view showing one example of the display screen of 
the ihteliigeht AV remote control in :the : oase. of bhoosihg a television channel in 

IP^^B&A§M [S £0 explanatory view showing one example of the display screen of 
the intelligent AV remote control at the time of choosing a television channel to view 
and listen in dravyjng 15 < and displaying the screen on ran rhtelligerit AV rem control 
further 

lD^win|J ?jlt is an expfehatc>ry view showing ohe example: of the display screen of 
the intelligent AV remote cohtroi at the time of choosing a help button in J_ 
etc. 

[Description of Notation?] 

101 The control section of ah intelligent A V remote control 
i 02 The indicator of an intelligent AV remote control 

103 The communications department of an intelligent AV remote control 

104 The input part of ah intelligent AV remote control 

105 the voice output part of an intelligent AV remote control 

106 The storage parts store of an ; inteliigent AV remote: control 
201 The input and indiciator of an intelligent AV remote control 
202,203.204 Communication interface of ah mtelitgeat" AV rts mote control 
205,208: Voice output part of an intelligent AV remote control 

303A, 3Q3B, and 303C Communication content performed between an ihtelligeint, A V 
remote control and AV equipment 

402; 403, 502 v 503, and 602:603,802:902 Input means in the exterior of an inteliigent 
AV remote cpntrpl 

404, 405; 408, 504, 505, 806; 604, and 605,606^803,903 Voice butput means in the 
exterior of arvintelligeht AV remote - contrpi 

701 -705-1001 -1005-1 1 01 -11 05-1 201^1 205-1 30 1 -i 306- 1 401 -1 405-1501 -1505-17 

01-1705 Icon of the AV equipment displayed on ah intelligent AV remote control 

1 208- 131 0 and 1 409. Video operation window 

1309-1508 and 1601 Volume control window of television 

1509-1602 Channel operation window of television 

1 708 The help window displayed when a help button is chosen 
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